experimental analysis
- North America > United States (0.04)
- Asia > China > Beijing > Beijing (0.04)
- Africa > Ethiopia (0.04)
ments [ ] The experimental analysis of Bachem et al. (2018) shows that the lightweight-coreset performs very similar
We thank all reviewers for their careful reading and their valuable comments. As seen in the figure on the right, the performance of Lucic et al. (2016) We now included this baseline in the paper. R1: The dimension of B is stated wrongly [..] Thank you for pointing "In contrast to k-means, we assume that the mean .." is not clear to me. Thank you for raising this issue. Reviewer 3 also pointed this out.
Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks
Hyun, Sangwon, Kim, Hyunjun, Jang, Jinhyuk, Choi, Hyojin, Babar, M. Ali
The application of Large Language Models (LLMs) is growing in the productive completion of Software Engineering tasks. Yet, studies investigating the productive prompting techniques often employed a limited problem space, primarily focusing on well-known prompting patterns and mainly targeting function-level SE practices. We identify significant gaps in real-world workflows that involve complexities beyond class-level (e.g., multi-class dependencies) and different features that can impact Human-LLM Interactions (HLIs) processes in code generation. To address these issues, we designed an experiment that comprehensively analyzed the HLI features regarding the code generation productivity. Our study presents two project-level benchmark tasks, extending beyond function-level evaluations. We conducted a user study with 36 participants from diverse backgrounds, asking them to solve the assigned tasks by interacting with the GPT assistant using specific prompting patterns. We also examined the participants' experience and their behavioral features during interactions by analyzing screen recordings and GPT chat logs. Our statistical and empirical investigation revealed (1) that three out of 15 HLI features significantly impacted the productivity in code generation; (2) five primary guidelines for enhancing productivity for HLI processes; and (3) a taxonomy of 29 runtime and logic errors that can occur during HLI processes, along with suggested mitigation plans.
- Asia > South Korea > Daejeon > Daejeon (0.04)
- Oceania > Australia > South Australia > Adelaide (0.04)
- Europe (0.04)
- (2 more...)
- Research Report > New Finding (1.00)
- Research Report > Experimental Study (1.00)
- Questionnaire & Opinion Survey (1.00)
- Education (0.93)
- Information Technology > Security & Privacy (0.46)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Automatic Programming (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Large Language Model (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.69)
Deep Learning for identifying systolic complexes in SCG traces: a cross-dataset analysis
Craighero, Michele, Solbiati, Sarah, Mozzini, Federica, Caiani, Enrico, Boracchi, Giacomo
The seismocardiographic signal is a promising alternative to the traditional ECG in the analysis of the cardiac activity. In particular, the systolic complex is known to be the most informative part of the seismocardiogram, thus requiring further analysis. State-of-art solutions to detect the systolic complex are based on Deep Learning models, which have been proven effective in pioneering studies. However, these solutions have only been tested in a controlled scenario considering only clean signals acquired from users maintained still in supine position. On top of that, all these studies consider data coming from a single dataset, ignoring the benefits and challenges related to a cross-dataset scenario. In this work, a cross-dataset experimental analysis was performed considering also data from a real-world scenario. Our findings prove the effectiveness of a deep learning solution, while showing the importance of a personalization step to contrast the domain shift, namely a change in data distribution between training and testing data. Finally, we demonstrate the benefits of a multi-channels approach, leveraging the information extracted from both accelerometers and gyroscopes data.
torchosr -- a PyTorch extension package for Open Set Recognition models evaluation in Python
Komorniczak, Joanna, Ksieniewicz, Pawel
The article presents the torchosr package - a Python package compatible with PyTorch library - offering tools and methods dedicated to Open Set Recognition in Deep Neural Networks. The package offers two state-ofthe-art methods in the field, a set of functions for handling base sets and generation of derived sets for the Open Set Recognition task (where some classes are considered unknown and used only in the testing process) and additional tools to handle datasets and methods. The main goal of the package proposal is to simplify and promote the correct experimental evaluation, where experiments are carried out on a large number of derivative sets with various Openness and class-to-category assignments. The authors hope that state-of-the-art methods available in the package will become a source of a correct and open-source implementation of the relevant solutions in the domain. Methods to solve this task are exceedingly demanded in the face of the growing popularity of deep neural networks, whose distinctive feature is unsupervised feature extraction [3]. This task is not trivial both in the context of method proposals and evaluation. Samples of known classes (KKC) are present both in the process of training and testing the model. One of the criteria for evaluating OSR methods is the correct classification within these classes. Unknown class samples (UUC), on the other hand, are used only in the process of testing methods [2]. The task of the algorithms is to mark these samples as instances of unknown classes.
- Europe > Poland > Lower Silesia Province > Wroclaw (0.04)
- North America > United States > Colorado > El Paso County > Colorado Springs (0.04)
- North America > Costa Rica > Heredia Province > Heredia (0.04)
Experimental Analysis of Machine Learning Techniques for Finding Search Radius in Locality Sensitive Hashing
Finding similar data in high-dimensional spaces is one of the important tasks in multimedia applications. Approaches introduced to find exact searching techniques often use tree-based index structures which are known to suffer from the curse of the dimensionality problem that limits their performance. Approximate searching techniques prefer performance over accuracy and they return good enough results while achieving a better performance. Locality Sensitive Hashing (LSH) is one of the most popular approximate nearest neighbor search techniques for high-dimensional spaces. One of the most time-consuming processes in LSH is to find the neighboring points in the projected spaces. An improved LSH-based index structure, called radius-optimized Locality Sensitive Hashing (roLSH) has been proposed to utilize Machine Learning and efficiently find these neighboring points; thus, further improve the overall performance of LSH. In this paper, we extend roLSH by experimentally studying the effect of different types of famous Machine Learning techniques on overall performance. We compare ten regression techniques on four real-world datasets and show that Neural Network-based techniques are the best fit to be used in roLSH as their accuracy and performance trade-off are the best compared to the other techniques.
- North America > United States > New Mexico > Doña Ana County > Las Cruces (0.04)
- Asia > Afghanistan > Parwan Province > Charikar (0.04)
Computational simulation and the search for a quantitative description of simple reinforcement schedules
Silveira, Paulo Sergio Panse, Siqueira, José de Oliveira, Bernardy, João Lucas, Santiago, Jessica, Meneses, Thiago Cersosimo, Portela, Bianca Sanches, Benvenuti, Marcelo Frota
We aim to discuss schedules of reinforcement in its theoretical and practical terms pointing to practical limitations on implementing those schedules while discussing the advantages of computational simulation. In this paper, we present a R script named Beak, built to simulate rates of behavior interacting with schedules of reinforcement. Using Beak, we've simulated data that allows an assessment of different reinforcement feedback functions (RFF). This was made with unparalleled precision, since simulations provide huge samples of data and, more importantly, simulated behavior isn't changed by the reinforcement it produces. Therefore, we can vary it systematically. We've compared different RFF for RI schedules, using as criteria: meaning, precision, parsimony and generality. Our results indicate that the best feedback function for the RI schedule was published by Baum (1981). We also propose that the model used by Killeen (1975) is a viable feedback function for the RDRL schedule. We argue that Beak paves the way for greater understanding of schedules of reinforcement, addressing still open questions about quantitative features of schedules. Also, they could guide future experiments that use schedules as theoretical and methodological tools.
- South America > Brazil > São Paulo (0.05)
- South America > Chile > Santiago Metropolitan Region > Santiago Province > Santiago (0.04)
- Health & Medicine (0.46)
- Education (0.46)